Goto

Collaborating Authors

 New Finding


Towards Federated Foundation Models: Scalable Dataset Pipelines for Group-Structured Learning Zachary Charles

Neural Information Processing Systems

We introduce Dataset Grouper, a library to create large-scale group-structured (e.g., federated) datasets, enabling federated learning simulation at the scale of foundation models. This library facilitates the creation of group-structured versions of existing datasets based on user-specified partitions, and directly leads to a variety of useful heterogeneous datasets that can be plugged into existing software frameworks. Dataset Grouper offers three key advantages. First, it scales to settings where even a single group's dataset is too large to fit in memory. Second, it provides flexibility, both in choosing the base (non-partitioned) dataset and in defining partitions.


New dinosaur discovered in Sahara desert was a horned 'hell heron'

Popular Science

New dinosaur discovered in Sahara desert was a horned'hell heron' 'Spinosaurus mirabilis' sported a 20-inch-tall'scimitar' on its head. Spinosaurus mirabilis stands along river's edge over its prey some 95 million years ago. A scimitar-shaped head crest and interdigitating teeth characterize this wading giant, one of the last-surviving spinosaurid species. Breakthroughs, discoveries, and DIY tips sent six days a week. Paleontologists still know comparatively little about fin-backed dinosaurs .


Can't stop humming that tune? Thank math.

Popular Science

Can't stop humming that tune? A lot goes into the successful'earworms,' including mathematical symmetry. Breakthroughs, discoveries, and DIY tips sent six days a week. While Super Bowl LX is over, the big game still echoes in the minds of many viewers. It's not your fault if a 30-second advertisement spot's melodic hook continues to keep you up at night, however.

  Country:
  Genre: Research Report > New Finding (0.37)
  Industry:

New discovery could help stop banana extinction

Popular Science

Fungal diseases are a major threat to the global banana supply. Breakthroughs, discoveries, and DIY tips sent six days a week. The popular fruit is threatened by a fungal disease called Fusarium wilt of banana (FWB), which blocks the flow of nutrients and makes it wilt. In the 1950s, the pathogen even made one species-Gros Michel bananas-functionally extinct. Fear not though, scientists are on it.




In search of the next generation of multimodal datasets

Neural Information Processing Systems

While these advances use different algorithmic techniques, e.g., contrastive learning, diffusion, or auto-regressive modeling, they all rest on a common foundation: large datasets containing paired image-text examples.